A New NN for Multiple View Shape from Shading

In this paper, we propose a new neural network (NN) design optimized by simulated annealing method for a robust 3D shape reconstruction. This NN deals with complicated task to reconstruct a complete representation of a given object relying only on a limited number of views and erroneous depth maps of shaded images. The depth maps are obtained by Tsai-Shah shape-from-shading (SFS) algorithm. We investigate the effectiveness of this scheme through experiments of reconstructing a mannequin object from its images. The reconstruction result is evaluated for each view by comparing mean square error (MSE) of the depth map recovered by our reconstruction scheme and the depth map recovered by the SFS method alone, with a true depth map obtained by a 3D scanner. The experimental results show the SA optimization enable our reconstruction system to escape from local minima. Hence, it gives more exact and stable results with small additional computation time.